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It has been recently suggested that when an Anderson impurity is immersed in the bulk ol a 
topological insulator, a Kondo resonant peak will appear simultaneously with an in-gap bound-state 
when the band-dispersion has an "inverted-Mexican-hat" form. The mid-gap bound-state generates 
another spin state and the Kondo effect is thereby screened. In this paper we study this problem 
within a weak-coupling RG scheme where we show that the system exhibits complex crossover 
behavior between different symmetry configurations and may evolve into a self-screened-Kondo or 
SO (3) low energy fix point. Experimental consequences ol this scenario are pointed out. 



Introduction 



The significance of topological insulators as a new state 
of matter has been stressed in numerous publications [l|- 
7]. So far, the main attention on the physics in topo- 
logical insulators has been focused on the surface states 
j9l422j. It was pointed out recently that impurity scat- 
tering may have non-trivial effects in the bulk of TI due 
to its particular band structure p3l - l25| . For topological 
non-trivial insulators with " inverted-Mexican-hat" band 
dispersion around the T- point, in-gap bound states are 
induced by impurities with arbitrary weak scattering (23| . 
The presence of the in-gap bound state affects profoundly 
the Kondo physics associated with magnetic impurities 
in the bulk of topological insulators. Using a slave-boson 
mean- field theory [24j , it was shown that the Kondo res- 
onance could be screened by the exchange interaction 
~ JdfSd • Sf (with Jjf > 0) between the spins of the 
Kondo (d) impurity and the induced bound-state (/), 
leading to a self-screened Kondo effect 24 1 . 



The physics described above is not limited to topolog- 
ical insulators but is a general consequence of insulators 
(and semi-conductors) with a large electronic density of 
states at the band edge such that in-gap bound states 
are easily induced by an Anderson impurity. The goal of 
this work is to perform a detailed analysis of the inter- 
play between the Anderson impurity and its induced in- 
gap bound state. Using a weak-coupling renormalization 
group (RG) analysis, we show that the system exhibits 
complex crossover behavior between different symmetry 
sectors and that the exchange interaction Jdf between 
the d- and /-spins may be renormalized dynamically to 
a negative value at suitable parameters regime. In this 
case the Kondo effect is not screened and the low energy 
physics of the system is described by an SO(3) Kondo fix 
point. The temperature dependence of the impurity in- 
duced resistance and magnetic susceptibility are studied 
at various regimes. 



Model 

We consider an Anderson impurity d in the bulk of an 
insulator. For concreteness we shall consider the Hamil- 
tonian of a two-dimensional topological insulator (2DTI) 
H = i?o + Hd + H t + V |24j , where H describes electrons 
in the bulk of the TI, 



H = hv F {k ■ a) + /3{i 



BH 2 k 2 }, (la) 



with a = t x <g) s and (3 = t z <£> sq, where t = (t x ,t y ,t z ) or 
s = (s x ,s y ,s z ) are vectors of the Pauli matrices acting 
in the space of isospins or spins, sq is the 2x2 identity 
matrix. The basis vectors are chosen as 



*k = 



( «kt \ 



(lb) 



where a-^ a or 6k CT are electron annihilation operators on 
two different orbits with momentum k and spin a =f, 4- 



Hd = £ d ^ Ud<J + UdTLd^Tldi, 



(lc) 



is the Hamiltonian for the Anderson impurity where td 
is the impurity energy level and Ud is the interaction 
between electrons on the impurity. The interaction be- 
tween the Anderson impurity d and the band electrons is 
described by H t + V, where 



H t = V d J2 ( a LA + iblja + H.c. 



(Id) 



k.cr 



describes tunnelling of electrons between bulk bands and 
d-level and 



v = v x; E4<A', 

a,/3— a,6 k,k'tr 



(le) 



where Vo ~ \Vd\ 2 /D is an effective potential scattering 
between band-electrons induced by the d-level. Dq is 
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the high-energy cut-off for the above Hamiltonian. We 
note that in usual analysis of Anderson impurity, the 
induced potential scattering term is neglected because it 
is irrelevant as far as Kondo physics is concerned. The 
situation is different here as we shall see in the following. 

We start with diagonalizing H + V. The eigenstates 
of Hq alone is given by 

H = X^fc^kaTftor, ( 2a ) 

where v = ±1 denotes the conduction and valence band. 

e k = ^M 2 + (hv F k) 2 , (2b) 

is the band dispersion where = mv 2 F — Bh 2 k 2 . 7^1^ 
are quasiparticle operators defined through the transfor- 
mation, 

akcr = e~ Mfc/2 |7 ckcr cos (^) + hvka sin (^Y^jY 
bka = e~' Qfc/2 j7 ck( r sin {^) - *7«k<r cos }> ( 2c ) 

where tan {pf) = V e*+M* £k IS 8 a PP C( i an d t ne m ~ 
sulator is topological for Bra > 0. For Bm > 1/2 (as- 
sumed hereafter), the band dispersion has an "inverted- 
Mexican-hat" form (see Fig. [ljwith dispersion minimum 
at a surface of nonzero wave-vector q's, with 

e„ = ^ y/±Bm - 1, q=— \ Bm--, (3) 
q 2B ' H KB V 2' W 

where g = |q|. 




FIG. 1: Energy dispersion f2bll for Bm = 20. The dark (bright) 
regions denote the energy levels below (above) the Fermi energy 
ep. The band-edges occur at momentum q at energies ±e 9 . (Here 
it is assumed that e q < ep < mv^,). ki and &2 ar e two solutions 
of the equation ek = ep. 

The corresponding density of states (DOS) is 

p[e) = 9(|e| - e q ) — (4) 



where g(e > e ) ~ y e i " J , and g(e -> e q ) — 

2 {^fiY = V 1 "^- Po = and 60 = 

mt)|. Notice that /5(e) diverge at the band edge e ~ ±e 9 . 



As was shown in Rcf. [23], because of the diverging 
density of states at band-edge, an in-gap bound state 
(denoted by /) is induced for arbitrary weak scattering 
Vo- The energy dispersion obtained after diagonalizing 
Hq + V has thus two parts: the bulk band structure 
described by Eq. © and an in-gap bound state described 
by an effective single-site Hamiltonian Hf, 

Hf = J2 e frtf° + u f n K n n> ( 5 ) 

where e f ~ -e q + {VoPo) 2 e q {l - (2BM)~ 1 ) is located 
above the top of valence gap for repulsive Vq. We have 
introduced an on-site Coulomb interaction U f for this 
localized in-gap state. The tunnelling Hamiltonian H t 
becomes in this new base H t — > H t + H d f , where 

H t = v d J2 (tLa + 4-yuJ) , (6) 

describes tunnelling of band electrons to/from the d- level 
and 

H df = V df J2{ftd, + dUa) (7) 

a 

describes tunnelling of electrons between d- and /-levels 
with V df ~ y/zVd, where z = Ek^(°l7i>k CT /J|0) ~ 
V e q pl{l - (2BM)' 1 ) and V d ~ V d . We have ignored the 
momentum dependence of V d in writing down Eq. ([6]). 
The Hamiltonians Ho+H d +Hf+H t +H d f given through 
Eqs. (HcJ), ©, ((5]), ©, 0, define an effective two- 
impurities model Hj^ describing the Anderson impu- 
rity. We note that although a particular model of 2DTI 
is employed in our derivation, the resulting model H^ 
describes quite generally any insulator/semi-conductor 
with large density of states at the band edge such that 
an in-gap bound state is induced by the presence of the 
Anderson impurity. 

Renormalization-Group Analysis 

In the following we shall perform a renormalization- 
group (RG) analysis for H\ l K To avoid confusion we 
first define various energy scales in our model. Unless 
otherwise specified, we shall assume U d — > 00 and 

e F - D < e d < ef < e F < 2e f + U f < e F + D , (8) 

where e F is the Fermi energy (see figure 1). We shall 
integrate out the high energy degrees of freedom succes- 
sively such that the bandwidth Dq — >• D < Dq is reduced 
correspondingly. 

We begin by analyzing the eigenstates of the effective 
impurity Hamiltonian H) = H d + Hf + H d f in the ab- 
sence of band electrons. The eigenstates of are spec- 
ified by the configuration numbers (N d , Nf) representing 
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the number of electrons on levels d and /. With energy 
scales specified by ((8j) the ground state has N d = Nf = 1 
and there are four possible states, a spin-singlet state \S) 
and three spin-triplet states |T m ) (m = 0, ±1). The sin- 
glet energy is modified when Vdf ^ while the triplet 
energy is unaffected. 



Diagonalizing H} J , we obtain 
1 5) = f^fJ ft_wt f 1 



l^l^/T-dT/Tj-^/t/tllo), ( 9 a) 



with energy £s = Q + £/ — ^J" an< ^ 

|T 1 )=4/t|0), |T_!) = 4/||0>, 



To) = -^{4/j + 4/ f t }|0), 



(9b) 



with energy £t = e d + ef, where as = yl — <^/> 

Pf = ^TTT and A/ = e f - e d + Uf. We note that 
£t > es, and the spin singlet state has lower energy. 

The RG flow can be divided into several regimes: 
(i) e d > cf — D > t-F — Dq, in this regime charge 
fluctuations in both d and / states exist and there is no 
Kondo effect; (ii) ep — D > e d but e/(~ — e q ) > ep — D or 
ep+D > 2ef + Uf, in this regime the charge fluctuations 
on the d orbital is quenched but charge fluctuations 
still exist on the / orbital, the system is in the single 
Kondo impurity (SU(2)) regime; (iii) ep — D > ef and 
cf + D < 2e/ + Uf, in this regime charge fluctuations 
in both d and / states are quenched and the system 
is at the self-screened Kondo regime if Jdf > and in 
the SO(3) Kondo regime if Jdf < 0. Notice we require 
Uf > ep — 2ef for this regime to exist. The RG analysis 
for the various regimes now follows: 
Regime (i): Charge fluctuations on the d-orbital can be 
integrated out using a renormalization procedure pro- 
posed by Haldane a long time ago [28j], but here the 
the spin-singlet and spin-triplet energies are, generically, 
renormalized seperately. We note that in addition to 
renormalization of energies Es(t) through H t , the poten- 
tial scattering term V and correspondingly ef and Vdf 
are also renormalized. However the renormalization of V 
is weak and does not introduce any qualitative changes 
in general 2^, 29[. Hence, for simplicity, we shall ignore 
the renormalization of V in the following. In this case the 
poor-man scalin g pr ocedure [28j j results in the following 
scaling equation 31, 32| for £s(t), 



de 



S(T) 



d\nD 



Vl T) p(e F + D) 



(10) 



where Vf 



a 2 s V c f and V$ 



V2- The difference between 



Vg and Vp originates from the appearance of the renor- 
malization factor as in the singlet state [see (|5a)) ]. Notice 



that Vg < Vp and the triplet energy level renormalizes 
faster than the singlet level. This opens the possibility 
that, as RG stops, the ground state of the system may 
become a triplet if the single-triplet level crossing occurs 
before the charge fluctuations in the d- and /-levels are 
quenched. 

Solving Eq. (|T0| , we find that the singlet-triplet energy 



spacing J d ){D) = e T {D) - e s {D) is given by 



(3}A f 1 



D 



zvjpo VA 

A 



(11) 



where D = Di ~ ep — e d at the end of scaling. 
Regime (ii): The charge fluctuation of the d- level is 
quenched at A ~ ep — e d and we may perform a 
Schricffcr-Wolf transformation for the d-level, resulting 
in an effective Hamiltonian Hj 11 ^ = Hq + H f + H d f + H^i 
where 

1 V 



H 



(a) 

K 



2 ^ 

<*0=7,f 



(12) 



where j a = X)i/k7 I/kcr describes band electrons, s is the 
vector of Pauli matrices, S d is the localized spin of the 
d-level and 



2\ J 



J ff : 



. 2Vdf 2 



-V d Vf 



The Hamiltonian H^- describes coupling of the <i-spin 
to 7 and / electrons. Notice that charge fluctuations in 
the /-orbital is allowed in H^f 1 through the mixed spin 
operator S TO = \ yy^aa 1 fa 1 ') and S£,. Fig. [2] clarifies the 
physics of the various interactions encoded in . 

Charge fluctuations in the /-orbital can be integrated 
out gradually in reg ime (ii) with Anderson's poor-man 
scaling approach [29(. As a result, the exchange coupling 
constants J a p are renormalized as, 



d\nD 
where j a p 



dja/3 _ . . p(eF 



D)+p(e F -D) 
2 Po 



J a pPo- Defining 



C(D f , Dl ) = J ^ 



dD p(s F + D)+p(e F -D) 



Dt 



we obtain 



P0 



(A)j 7/3 (A)/;(AA 



(13) 



(14) 



(15) 



i-j 77 (A)£(AA) 

The scaling invariant, that is, the Kondo temperature 
Tj( i is obtained by solving the equation 

(a) 



j 77 (A)£(?r ; ,A) = l 



(16) 
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(a) 




I I I 

a' a' 

l l 



E F~ E d E f~ B d 



FIG. 2: Transitions induced by Hji , Eq. (112ft leading from an 
initial state on the left and ending at a final state on the right. 
The various processes are associated with exchange constants (a): 
J 77 , (b): Jff and (c): J 1 j and J/ 7 



and scaling stops if T^f 1 > Da = min{e^ — tf ,U / — cf 



e/}, indicating that the d-spin is quenched by the Kondo 
effect. This happens if (a) ep < —s qi in which case the 
(f-spin is quenched by ordinary Kondo effect and the in- 
gap bound state becomes irrelevant; or (b) if j 77 (A) is 
large enough. We note that C(Da,Di) remains finite as 

long as Da > 0. 

(a) 

For < Da, scaling stops at D = Da. The effective 
coupling between /- and d-spins is a sum of contributions 
from Hdf and H™\ i.e. 



K 



Jdf = J$(Di) + J f f(D u ). 



and is ferromagnetic if J d f < 0. Assuming that I — 
,?' 77 (A)£(Ai, A) is of order 0(1), e F ~ e q < e < \e d \ 
and Uf < |e<i|, we find that Jff(Da) is of the same order 

as f3}A f and J df < if \V d \ 2 > e|^|. 
Regime (Hi): The scaling stops at regime (ii) with Da ~ 
£i? + e q if the chemical potential is located inside the 
band-gap which is the usual case for insulators. A more 
interesting scenario occurs if the chemical potential cf 
is located above the band-gap which may happen if the 
insulator is doped by impurities. Scaling continues in this 



case where charge fluctuations in /-level is also quenched. 
In this case the mixed spin term S m becomes ineffective 
and we left with an effective Hamiltonian = H + 



H 



(Hi) 
K > 



where 



H 



(Hi) 
K 



Ja'S 7 • S d + JdfSf ■ S Q 



(17) 



where 



t 



^7 — 7J 



Here J K = J 77 (Ai) = J 77 (A)/(1 - jry(A)£(Ai, A))- 
Notice that \J d f\ is in general smaller than Jk by the 
renormalization factor z. 

It is interesting to note that for Da ^> \J d f\, there ex- 
ists a regime D 3> | J d f | where the system is governed by 
the critical point between the SO (3)- and the quenched- 
Kondo regimes which has SO (4) symmetry [26j]. In this 
regime the behavior of the system is governed by the 
SO (4) critical point. The system crossovers to the low 
temperature 50(3)- or self-screened-Kondo regime at 
D < |J d /|. We first consider the SO (4) regime D > \J df \. 
SO(4) Kondo fixed point: In this case J d f = and we 
may apply the Schricffer-Wolf transformation directly to 
the spin-singlct and triplet states to obtain, 



H 



SO(4) _ 
K 



Jt(S • S 7 ) + Jst(R- • S 7 



(18) 



where S and R are the (S = 1) spin operator and the 
Runge-Lenz operator, respectively with 



S + 
S z 
R+ 
R z 



2 X 



10 



X 



ii 



X 1 



X 

-- V2(X 1S - X 

:-(X 0S + X S0 



s~ 



R~ 



21 X 



01 



X 



10\ 



2(X S1 -X ls 



(19) 
(20) 



Here X AA ' = |A)(A'|, |A(A')) = \S), \T m ) (to = 0,±1) are 
the spin singlet and triplet states. The coupling constants 
are given by Jt = Jk/2 and Jst = o-sJt- 

The scaling equations for the dimensionless couplings 
jk = JaPo are, 

dj T i . 2 .2 \ p(£f + A + p(£f - D) 

— (Jt + .?stJ 



d\nD 

djsT 
d\nD 



2po 

p(e F + D)+ p(e F - D) 
2 Po 



(21) 



The scaling equations can be solved by introducing 
coupling constants j n = jx — (—^) n jsT [n = 1,2]. It 
is easy to show that 



Jn(D) = 



jn(Du) 



l-i„(Ai) C(D,D U ) 
The couplings jx and jst are then given by 

(m ji(D) + (-MP) 
3t(st){D) . 



(22) 



(23) 
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The scaling stops at the Kondo temperature Tr- 4 de- 
termined from the equation, 



{jr(S«)+isr(5«)} C(T Ki ,D v 



= 1 



(24) 



if Tx 4 3> For Tr- 4 < J d f, the system flows to 

the 5*0(3) fix point if J d f < 0. For J df > 0, the two 
spins form a spin-singlet (self-screened Kondo effect) at 
D ~ J rf/ . 

50^ Kondo fix point When J d / < and Tjc 4 < \ Jdf\, 
renormalization of jsr stops at D = Dm ~ | J d f | . For 
D < -Diii, the Kondo Hamiltonian becomes 



H 



SO(3) 
if 



The scaling equation for jp = Jppo is 

djr . 2 P( £ F + D ) + P{ £ F - D) 



dlnD ~ Jt 
with the usual solution 

Jt(D) = 



2/90 

ir(Aii) 



1 - jT(Dui)C(D,D i 



(25) 



(26) 



(27) 



The scaling stops at the Kondo temperature Tk 3 deter- 
mined from the equation, 



jriDiu) C(T K31 D 



i. 



(28) 



Resistivity and Impurity Magnetic Susceptibility 

Having elaborated upon the theory in the weak cou- 
pling regime T 3> TV's wc arc now in a position to 
carry out perturbation calculations of experimental ob- 
scrvablcs. In 3D, the most accessible ones are the impu- 
rity resistivity Ri mp (T) and the impurity magnetic sus- 
ceptibility Xim P (T). We shall be guided by the quest to 
find out how the special features of the TPs are reflected 
in these observables. These features are the occurrence 
of gap and the structure of the DOS especially near the 
band edges ±e g . In addition, reducing the temperature 
results in the crossover between different scaling regimes 
of the couplings. Explicitly, there are three relevant 
temperature regimes denoted as (ii) , (in) , (iv) in order to 
match the notation of the corresponding scaling regimes 
discussed previously. The first regime, denoted as (ii), is 
defined by [Di > T > Da] as given by equation ([T3| for 
scaling interval (ii). Local moment behavior exists only 
at the d-level in this regime and therefore there is Kondo 
scattering with SU(2) symmetry. The second regime, de- 
noted as (Hi), is defined by equation (|2"Tj) for scaling in- 
terval (Hi) [Da > T > Dm]. Here one may neglect 
the difference in energies between the singlet and triplet 
states and the system is at the SO (4) Kondo regime; 
The third regime, denoted as (iv), is defined by equation 
for scaling interval (iv) [Dm > T > Tk 3 ]- Here 



there is Kondo scattering with SO (3) symmetry (when 
Jdf < 0) or the Kondo effect is screened if J d f > 0. The 
temperature dependence of the resistivity and magnetic 
susceptibility in these three different scaling regimes are 
distinct. 

We assume that > e q (i.e. the TI is doped) and the 
system has a Fermi surface in the calculation of resistiv- 
ity. The impurity resistivity as calculated in the frame- 
work of the "poor man's scaling" formalism is given by, 



R 



N v Ro 



imp 



c 2 (T Kv ,ry 



(29) 



where v = (ii) , (Hi) , (iv) , denotes the pertinent tem- 
perature regime as detailed above. The correspond- 
ing Kondo temperatures are Tk u (|16|) . TK ui = Tk 4 
([21]) or T Kiv = Tk 3 (|28]>. the numerical factors N v arc, 
Nu = Nm =3/4 and N iv = 2. The constant R is 



Ro 



1 



he 2 pl v\ + v\ ' 



de ks 



where k\ and &2 are two solutions of the equation eu = £f 
(see Fig. p. 




0.001 o.oi o.i 



FIG. 3: Resistivity H29H as a function of temperature for = 
—S0e q , so = 24e<j, ep = 2e q and different values of j: j = 0.1 [ref 
curve], j = 0.12 [purple curve] and j = 0.14 [blue curve]. The dots 
denote T = Da and T = Dm separating the temperature intervals 
(ii), (iii) and (iv). 



The resistivity as a function of the temperature is 
shown in FigJ3] It is seen that i?i mp has different tem- 
perature dependence within the temperature intervals 
(ii), (Hi) and (iv), with kinks observed at T = Da and 
T = Dm [the points Da and Dm are denoted by dots]. 

The Kondo scattering manifests itself also in the mag- 
netic susceptibility [3l|. The impurity susceptibility cal- 
culated in the framework of the "poor man's scaling" is 



T 



1 



(30) 



where xo = 4ci mp /^/Tft' ii , v = (ii), (Hi), (iv), the Kondo 
temperatures are T Kii ([To]), T Kiii = T Ki ||2iJ| or T Kiv = 
Tk 3 HMD, K u = Km = 1/4, K iv = 2/3, P tl = P iv = 1 
and Pm = 2. 

The impurity magnetic susceptibility as a function of T 
is shown in FigHJ The different temperature dependences 
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Foundation (ISF). 



0.01 



0.001 



10" 




0.001 



FIG. 4: Magnetic susceptibility l|30|l as a function of temperature 



for e d 



-80e g , eo = 24e g , ep = 2e q and different values of j: 



j = 0.1 [ref curve], j = 0.12 [purple curve] and j = 0.14 [blue 
curve]. The dots denote T = Da and T = Dm separating the 
temperature intervals (n), (Hi) and (iv). 



°f Ximp at different temperature regimes (ii), (Hi) and 
(iv) are obvious, with kinks observed at T = Da and 
T = Dm [the points Da and Dm are denoted by dots] . 



Summary 

In this paper we analyze the interplay between the 
Anderson impurity and its induced in-gap bound state 
in a model of 2D topological insulator. Using a weak- 
coupling Renormalization Group (RG) analysis, we show 
that the exchange interaction Jdf between the d- and 
induced /- spins may be renormalized dynamically to ei- 
ther positive or negative values. The parameters required 
to observe the above phenomena is not too restrictive 

3 

(\Vd\ > e 2 vMi e o < Uf < U d ) and is realistic. The 
system exhibits complex crossover behaviors at different 
parameter regimes as a result which can be observed in 
the temperature dependence of the impurity induced re- 
sistance and magnetic susceptibility. The crossover in 
the temperature dependence of both the resistivity and 
the impurity magnetic susceptibility at different regimes 
is a peculiar feature that can serve as an experimental 
confirmation of the above analysis. 

We note that the physics described above is not limited 
to topological insulators but is a general consequence of 
(doped) insulators (and semi-conductors) with a large 
electronic density of states at the band edge such that 
in-gap bound states are easily induced by an Anderson 
impurity. Similar physics may be found in for example, 
two-layer graphene systems. Our paper is just a first 
step towards understanding the rich physics associated 
with impurities in these systems. 
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